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Fire Detection Algorithm 
Field of the Invention 

The invention relates to the field of video processing and fire detection and 
S specifically an algorithm is described that allows the detection of a flame from a 
digitised video data stream. A system for video flame detection is described. 

Background 

The use of video camera and digital video processing techniques for determining and 
tO detecting features from the image are well known in the art. The inventors have 

previously disclosed in PCT Application GB99/03459 a system for detecting smoke in 
the image. These systems are used as another sensor input for a fire alarm svstem. Flame is a 
further component in combustion and it is possible to have a fire event that produces 
no smoke. An algorithm that detects the presence of flame within a video image 
IS provides a further input into the fire detection process. 

Summary of the Invention 

According to the present invention there is provided an algorithm that extracts 
features from a video data stream and is able to detect the presence of flame within the 
20 video data stream. 

According to a further aspect of the invention there is provided a system for providing 
an alarm indicating the presence of flame within a scene that is observed by a video 
camera. 

25 

Brief Description of the Drawings 

Embodiments of the invention will now be described, by way of example, with 
reference to the accompanying drawings, in which: 
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Figure 1 shows the block diagram of the flame detection system, 
Figure 2 shows the steps comprising the algorithm 
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Detailed Description 

The flame detection system shown in Figure 1 comprises an analogue black and white 
video camera, 1, which outputs a standard 625 line analogue video signal at a 25Hz 
S frame rate to a frame grabber card, 2. Cameras are widely available and the inventors 

are using a standard YHS video camera from Hitachi. The frame grabber card 
^igitises)the image to a resolution of 640 pixels per line with 480 lines and passes the 
^gitised)image into the processor, 3, at the frame rate. The frame grabber card is a 
standard piece of hardware and a National Instruments PCI 1411 device plugged into 

10 the PCI bus of a standard PC is used. The processor 3, comprises a standard IBM™ 

PC using a 750MHz Intel Pentium 3™ processor with l28Mbytes of RAM. The 
processor executes the algorithm, which is coded in a mixture of LabView™ and 
Microsoft™ Visual C + + . The processor outputs an alarm signal, 4, by means of a 
standard serial RS232 link. This output may be used in a number of obvious ways to 

fS indicate a fire alarm event. 

The algorithm comprises a scries of steps labelled SI to S7 in the flow chart shown in 
Figure 2. These steps are now described. 

20 In step 1, the video image(is) entered into the algorithm is in the form of a 

monochrome 640 x 480 image .where each image pixel has an intensity value of 8 bits 
resolution. The algorithm processes each pixel individually, using linear 
mathematical operations. 

25 In step 2, the monochrome 640 x 480 8 bit image is used to generate two separate 

averaged 640 x 480 8 bit resolution images which filter out rapidly occurring events, 
one with filter set at 1.25Hz and the other with a filter set at 4.0Hz. The absolute 
difference between the pixel values of these rwo images is then taken to obtain a 
movement band 640 x 480 8 bit image, which displays entities that are moving in the 

JO image within the frequency band between l.25Hz and 4.0Hz. This frequency band 

corresponds with the range of movement frequencies exhibited by petrol flames 
observed empiricallv by the inventors. 
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In the first averaged image, a dimensionless time constant kl, is used to generate a 
640 x 480 resolution 8 bit image that filters out events that occur more rapidly than 
4Hz. 

* is calculated using the following relationship: 

kl = l/(4Hz x time in seconds between successive frames) 

kl is then used to generate an image that filters out events that occur at higher 
W frequencies than 4Hz in the following manner. 

pMl = kl x (live pixel image value) + (1 - kl) x (value of pMl from previous frame) 

where pMl is a rolling average with a starting value of zero. Each pixel in the 
>S 640 x 480 Live image has a corresponding value of pMl which can be used to make 

up the averaged image. 

In the second averaged image, a dimensionless time constant k2, is used to generate a 
640 x 480 resolution 8 bit image chat filters out events that occur more rapidly than 
20 1.25Hz. 

k2 is calculated in the following relationship: 

k2 = 1 /(1.25Hz x time in seconds between successive frames) 

25 

k2 is then used to generate an image that filters out events that occur at higher 
frequencies than i.25Hz in the following manner. 

pM2 = k2 x (live pixel image value) + (I - k2) x (value of pM2 from previous frame) 

}Q 

where pM2 is a rolling average with a starting value of zero. Each pixel in the 640 x 
480 image has a corresponding value of pM2 which can be used to make up the 
averaged image. 
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Once the two 640 x 480 cime filtered images with pixel values equal to pMl and pM2 
have been generated a so-called movement band 640 x 480 resolution image is 
generated by taking each of the pixels of these averaged images and calculating the 
absolute difference berween pMl and pM2 by finding the magnitude of the 
difference between each of the individual pixels obtained by subtracting pMl from 
pM2. In this manner, a 640 x 480 image is obtained which only displavs events that 
occur in the frequency band between 1.25 Hz and 4 Hz. Each pixel of the movement 
band image has an 8 bit resolution. 
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In step 3, once an image has been filtered using the movement band, the filtered 
image has a threshold applied to create a map of significant movement in the 
characteristic frequency band defined by kl and k2. The study of the temporal 
dynamics of these highlighted pixels is used to decide whether or not flames are 
)> present in the video image. The best value for this threshold, based on the 

observation of outdoor petrol flames is equal to a value of 5% of the dvnamic range 
of values in the 640 x 480 8 bit movement band image, is tl = 13, rounded up to the 
nearest whole number. In the application written in LabYiew™, the user of the 
system can set this value to an arbitrary value berween 0 and 255 using the graphical 
user interface provided by Lab View™. If a pixel value of the movement band image 
is greater than the threshold value, it is entered as 1 into the threshold map. If a 
pixel value of the movement band image is lower than the threshold value it is 
entered as 0 into the threshold map. The threshold map is a Boolean image of 640 x 
480 pixels where non-thresholdcd pixels have a value of zero, and thresholded pixels 
25 have a value of one. 



In step 4, the "awareness map" is a subset of the "threshold map". In order to 
generate the awareness map, each pixel in the threshold map defined in step 3 has an 
awareness level, which is an indication of the likelihood of a flame existing within 
that particular pixel. If the awareness level, increases above a user-defined threshold 
defined as the integer t2 (nominal value of 40), then the thresholded pixel is 
registered with binary value 1, into the awareness map. 
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The "awareness map" is a 640 x 480 Boolean image. An integer defined as the 
awareness level is generated for each of the pixels in the "awareness map". The value 
of the awareness level is calculated by comparing successive frames of the "awareness 
map". When the program begins, the value of the awareness level for each of the 
pixels is equal to zero. 

If a pixel in the awareness map. changes from 1 to 0 or changes from 0 to 1 between 
successive video frames, then 2 is added to the value of the awareness level for that 
pixel. If a pixel in the awareness map does not change (i.e. stays at 0 or stavs at 1) 
JO between successive frames, then I is subtracted from the awareness level. The 

minimum value of the awareness level is zero i.e. if the awareness level becomes 
negative it is immediately set to zero. 

This means that flickering movements within the frequency band defined bv kl and 
hS k2 will cause a rapid increase in the awareness level for each individual pixel. These 

flickering movements have been observed by the inventors to be characteristic of * 
flame. 

In step 5, a number of parameters are calculated so that the algorithm can decide 
20 whether a flame is present in the video images that are being processed. These 

parameters may be plotted in a moving graph or used to determine a confidence of a 
flame detection event. The PlotO parameter is a constant equal to an integer called 
the Alarm Level, user defined with a default value of 20. A flame is registered in the 
system when the Plot2 parameter described below exceeds the Alarm Level, which 
25 has a nominal value of 20. Low values of Alarm Level mean that the system is fast to 

react to possible flames in the picture, but is susceptible to false alarm events. 
High values of Alarm Level mean that the system is insensitive to false alarm events, 
but is slow to react to possible flames in the picture. 

30 The Plot! and Plot2 parameters are calculated in the following manner by scanning 

horizontally across the "awareness map". As the scan is performed from left to right 
across each horizontal line of the "awareness map" the value of adjacent pixels are 
compared and a value is entered into an edge counter that starts at a value of 
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zero. If adjacent pixels are equal to one anocher then nothing is added to the edge 
counter. It adjacent pixels are not equal to one another then 1 is added to the edge 
counter. At the same time, the total number of pixels with binary value I is counted 
and added into a pixel counter. This operation is performed for each of the 480 lines 
5 of the image (from top to bottom) and the values for the edge counter and the pixel 

counter are summed. Ac the end of this procedure two integers have been calculated. 
These arc: 
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Edgesum = Sum of horizontal edge transitions in awareness map as described. 
PLxelsum = Total number of pixels with binary value 1 in the awareness map as 
described above. 

In parallel with this the coordinates of the pixels with binarv \-alue 1 are noted. A 
region of interest is defined by noting the following quantities: 

xl = Minimum x coordinate 
x2 = Maximum x coordinate 
yl = Minimum y coordinate 
v2 = Maximum v coordinate 



The area of the region of interest is defined as: 
ROIarea = (x2 - xl) x (y2 - yl) 
25 The Plotl parameter is calculated as follows: 
Plotl = (Tixelsum - Edgesum)/ROIarea 



This is a measure of the sparseness of the flicker in the image, and can be used to 
discriminate between treelike objects and more densely packed flame like objects. If 
Plotl is less than zero then the image is sparse and if Plotl is greater than zero the 
image is dense. 
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The Plot2 parameter is calculated as follows: 

Plor2 = Pixelsum/ROIarea 

5 In step 6, prior to performing the final flame decision, the "plot" parameters described 
above are smoothed using a user defined dimensionless time constant k3 with a time 
constant of 8.0 seconds. k3 is calculated in the following manner: 

k3 = 8.0s/( time in seconds between successive frames) 

JO 

k3 is applied between successive values of Plotl and Plot2 obtained from successive 
video images using the same filtering techniques as used by kl and k2 described in a 
previous part of the document. This reduces the noise level in the plotted parameters 
and reduces the false alarm rate. The decision whether a flame is occurring within the 
is video image has rwo operator selectable modes: normal mode and tree filter mode. 

When it has been determined that a flame is occurring in the picture, an alarm is set oTf 
to indicate the presence of a flame threat. 

Normal flame decision mode is employed when no treelike objects are in the picture. In 
20 this mode, Plotl is ignored. Here, an alarm is triggered when the Plot2 parameter is 
greater than the user defined PlotO parameter. 

In tree filter mode, it was found that the flicker movement detected by the algorithm 
was sparsely distributed for a treelike object and densely distributed for a fire. A 
25 positive value of Plotl indicates a densely packed arrangement of flickering pixels i.e. a 
flame, and a negative value of Plotl indicates a sparsely packed arrangement of 
flickering pixels i.e. leaves on a tree moving in the wind. 

The alarm for a flame with the tree filter on only occurs when Plot 2 is greater than the 
PlotO AND Plotl is greater than zero. 

W 

The inventors have found that inclusion of the tree filter increases the selectivity of the 
system, bur also increases the amount of time required to reach a decision on whether a 
flame is present in the picture. 
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Additional Embodiments 

The algorithm described above has been oprimiscd by empirical methods and the constants 
determining the function of the algorithm may be chosen to achieve optimum results within the 
5 scene environment. 

Further it can be seen that systems comprising colour video images, or with differing pixel 
resolutions may be processed by such algorithms. Extensions to the algorithms above will be 
obvious to those experienced in the an. 

0 

The techniques and man-machine interface described in the applicants smoke detection svstem 
described in PCT application GB99 / 03459 can be applied to the flame detection system 
described above. 
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